Silent Speech Interface Using Ultrasonic Doppler Sonar

Multimodal Silent Speech Interface based on Video, Depth, Surface Electromyography and Ultrasonic Doppler: Data Collection and First Recognition Results

Silent Speech Interfaces use data from the speech production process, such as visual information of face movements. However, using a single modality limits the amount of available information. In this study we start to explore the use of multiple data input modalities in order to acquire a more complete representation of the speech production model. We have selected 4 non-invasive modalities – ...

Brain Computer Interface using Silent Speech for Speech Assistive Device

Array-based Electromyographic Silent Speech Interface

An electromygraphic (EMG) Silent Speech Interface is a system which recognizes speech by capturing the electric potentials of the human articulatory muscles, thus enabling the user to communicate silently. This study is concerned with introducing an EMG recording system based on multi-channel electrode arrays. We first present our new system and introduce a method to deal with undertraining eff...

Toward a Silent Speech Interface based on Unspoken Speech

This work aims to interpret the EEG signals associated with actions to imagine the pronunciation of words that belong to a reduced vocabulary without moving the articulatory muscles and without uttering any audible sound (unspoken speech). Specifically, the vocabulary reflects movements to control the cursor on the computer. We have recorded EEG signals from 21 subjects using a markers based ba...

Performance of the MVOCA silent speech interface across multiple speakers

This paper investigates the performance of a silent speech interface (SSI) based on permanent-magnetic articulography (PMA) across several speakers. In a previously published study, the SSI was shown to be capable of distinguishing between voiced and unvoiced plosives ([b,p] and [d,t]) in data recorded from a single speaker; a surprising result in a system without access to speech acoustics. Th...